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PARAMETER ESTIMATION IN DIAGONALIZABLE STOCHASTIC 

HYPERBOLIC EQUATIONS 



W. LIU AND S. V. LOTOTSKY 



" Abstract. A parameter estimation problem is considered for a linear stochastic 

hyperbolic equation driven by additive space-time Gaussian white noise. The damp- 
ing/amplification operator is allowed to be unbounded. The estimator is of spectral 
type and utilizes a finite number of the spatial Fourier coefficients of the solution. 
The asymptotic properties of the estimator are studied as the number of the Fourier 
coefficients increases, while the observation time and the noise intensity are fixed. 

m 

1. Introduction 

p | , A typical example of a parabolic equation is the heat equation 

+-> . 

a typical example of a hyperbolic equation is the wave equation 

u u = u xx . 

In a more abstract setting, if A is linear operator such that ii + Au = is a parabolic 



> 

m 
in 
m 



equation, then 

u + Au = 

is natural to call a hyperbolic equation; ii and ii are the first and second time derivatives 
of u. 

Damping in a hyperbolic equations is introduced via a term depending on the first 
^ ! time derivative of the solution. For example, a damped wave equation is 

> 

Indeed, if we define the total energy E(t) = f (uf(t,x) + u x (t,x))dx, then integration 

S— i ■ by parts shows that 

c3 ' 



Uu = u xx — aut, a > 0. 



—E(t) = —a / u1{t 1 x)dx] 



it also shows that a < (negative damping) corresponds to amplification. More gen- 
erally, we write a damped linear hyperbolic equation in an abstract form 

(1.1) ii + Au = Bu, 

where A and B are linear operators on a separable Hilbert space H; depending on the 
properties of the operator B, the result can be either damping or amplification. 

In this paper, we consider a stochastic version of (11 .11) . perturbed by additive space- 
time white noise and with operators A and B specified up to an unknown parameter: 

(1.2) u + (A + 9 1 A 1 )u = (B + 6 2 B 1 )u t + W, < t < T. 
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The objectives are 

• to determine the conditions on the operators so that the equation has a gen- 
eralized solution that is a square-integrable random element with values in a 
suitable Hilbert space; 

• to construct a maximum likelihood estimator of the unknown parameters 9i, 82 
using a finite-dimensional projection of the solution, and to study the asymp- 
totic properties of the estimator as the dimension of the projection increases. 

For stochastic parabolic equations with one unknown parameter, a similar problem 
was first suggested by Huebner, Khasminskii and Rozovskii [I] and was further inves- 
tigated by Huebner and Rozovskii [5]. Estimation of several parameters in parabolic 
equations has also been studied [3J, [TO] - For stochastic hyperbolic equations, most of 
these problems remain open. Since the equation is second-order in time, it is natural 
to start with two unknown parameters. In the case of the wave equation, these pa- 
rameters correspond to the propagation speed of the wave and the damping coefficient 

i- 

With precise definitions to come later, at this point we interpret W(t) as a formal 
sum 

w{t) = J2 h kMt), 

k>\ 

where {h k , k > 1} is an orthonormal basis in the Hilbert space H, and Wk{t) are 
independent standard Brownian motions. We look for the solution of (II. 2p as a Fourier 
series 



T.3) u(t) = y]ttfc(t)fejfc, 



fe>i 

and call it a generalized solution. If the trajectories of Uk(t) are observed for 
1 < k < N and all < t < T, then there exists a closed-form expression for maximum 
likelihood estimator of (9i,9 2 ) in terms of u k and u k ; see Section [3] below. 
The main technical assumptions about the equation are 

• zero initial conditions (to simplify the presentation); 

• the ability to write equation (11.21) as an infinite system of uncoupled stochas- 
tic ordinary differential equation (this is essential in the construction and the 
analysis of the estimator). In other words, we assume that the equation is 
diagonal izable: the operators Ao, A%, Bq and B\ have a common system of 
eigenf unctions {h^, k > 1}: 

(1.4) A h k = K k h k , B Q = p k h k , A x h k = T k h k , B\ = v k h k 

and this system is an orthonormal basis in the Hilbert space H. 

• hyperbolicity, that is, 

(1) there exist positive numbers C*, ci, c 2 such that {n k + 9r k + C*, k > 1} is 
a positive, non-decreasing, and unbounded sequence for all 9 G ©i and 

K k + 9'r k + C* 

for all 9,9' G 0i ; 
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(2) there exist positive numbers C, J such that, for all k > J and all Q\ G 

e 1; e 2 e e 2 , 

(1.6) T{p k + e 2 Vk)<H^k + Om)+c. 

If equation (11.21) is diagonalizable and the solution has the form (II. 3p , then the Fourier 
coefficient Uk satisfies 

u k - (pk + 9v k )uk + (i^k + 9iTk)Uk = w k , u k (0) = Wfc(O) = 0. 

We show in Section [2] that if the equation is also hyperbolic and X is a Hilbert space 
such that H C X and the embedding operator j : H — > X is Hilbert-Schmidt, then u 
is an X-valued process. 

The maximum likelihood estimators of 9\ and 9 2 are constructed in Section [3] using 
the processes Uk, Uk, k = 1, . . . , N (the corresponding formulas are too complicated to 
present in the Introduction). Analysis of these estimators in the limit N —>■ 00 is the 
main objective of the paper and is carried out in Sections H] and [5j Here is the main 
result of the paper for the case when A4, Bi are (pseudo) differential elliptic operators. 

Theorem 1.1. Assume that equation (11.21) is diagonalizable and hyperbolic and that 
Ai,Bi are positive- definite elliptic self-adjoint differential or pseudo-differential oper- 
ators on a smooth bounded domain in M. d with suitable boundary conditions or on a 
smooth compact d-dimensional manifold. Then 

(1) the maximum likelihood estimator of 9\ is consistent and asymptotically normal 
in the limit N —>■ 00 if and only if 

n ^ , , . v . order (A + O1A1) + order(£ + 2 #i) - d 

(1.7) order(^i) > ; 

(2) the maximum likelihood estimator of 9 2 is consistent and asymptotically normal 
in the limit N — > 00 if and only if 

(1.8) order(i3) 1 > ^i^H. 

Similar to the parabolic case (Huebner [3]), the results of the paper extend to a more 
general estimation problem 

n m 

u + OuAiU = ^ °2jBjU + W, 

i=0 j=0 

as long as all the operators Ai, Bj have a common system of eigenfunctions. For 
example, in the setting similar to Theorem 11.11 the coefficient 9\ p can be consistently 
estimated if and only if 

order (J27=o 9\iAi) + order \ YJj=o ®2jBj) ~ d 
order (A p ) > . 

Throughout the presentation below, we fix a stochastic basis 
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with the usual assumptions (completeness of JF and right-continuity of JF t ). We also 
assume that F is large enough to support countably many independent standard Brow- 
nian motions. For a random variable £, E£ and Var£ denote the expectation and vari- 
ance respectively The time derivative of a function is denote either by a dot on top 
(as in u) or by a subscript t (as in u t ). 

The following notations are used for two non-negative sequences a n , b n , n > 1: 

(1.9) a n ex b n 

if there exist positive numbers c 1; c 2 such that C\ < a n /b n < c 2 for all sufficiently large 

n; 

(1.10) a n x b n 
if 

(1.11) lim — = c for some c > 0; 

(1.12) a n ~ b n 

if (11.111) holds with c = 1. Note that if a n ~ b n and X]n a « diverges, then J^^ =1 ~ 

Finally, we recall that a cylindrical Brownian motion W = W(t), t > 1, over (or on) 
a Hilbert space if is a linear mapping 

W : f i-> W)(0 

from if to the space of zero-mean Gaussian processes such that, for every f,g <E H 
and £, s > 0, 

(1.13) E(W7(W(s)) =mHt,s)(f,g) H . 

A cylindrical Brownian motion W is often written as a generalized Fourier series 

(1.14) W(t) = J2Mt)h k , 

k>l 

where Wk = Wh k - The corresponding space-time white noise is written as 

W(t) = J2w k (t)h k . 

k>l 

2. DlAGONALIZABLE STOCHASTIC HYPERBOLIC EQUATIONS 

We start by introducing the following objects: 

(1) H, a separable Hilbert space with an orthonormal basis {hk, k > 1}; 

(2) X, a separable Hilbert space such that H is densely and continuously embedded 
into X and 



(2.1) ^IIMl- < oo 



k>l 



(in other words, the embedding operator from H to X is Hilbert-Schmidt); 

(3) Ao, Ax-, ^0; £>u linear operators on H; 

(4) 0!, 2 , two compact sets in R; 

(5) 9\, 02, two real numbers, 9\ G ©i, 62 G 2 ; 
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(6) (fl, T, (J 7 t)t>ii P)> a stochastic basis with the usual assumptions and a countable 
collection of independent standard Brownian motions {w k = w k (t), k > 1}. 

In this setting, a cylindrical Brownian motion = W(t) on if is a continuous 
X-valued Gaussian process with representation 

(2.2) ^(t) = ^to(t). 

fc>i 

The process W indeed has values in X rather than H because 

nW(t)f x ^t^\\hk\\ 2 x <oc. 

k>l 

For fixed non-random T > 0, consider the second-order stochastic evolution equation 

(2.3) u u (t) + (A + e 1 A 1 )u(t) = (B + 9 2 B 1 )u t (t)+W(t), < t < T, 
with zero initial conditions u(0) = u t (0) = 0. 

Definition 2.1. Equation (12.31) is called diagonal izable if the operators Aq, Ai, Bq, 
and B\ have a common system of eigenf unctions {h k , k > 1}. 

We will refer to A = Ao+0iAi and B = Bq+6 2 B\ as the evolution and dissipation 
operators, respectively, and use notations (jl.4p for the eigenvalues of the operators 
At, Bi. Hyperbolicity of the equation means that the evolution operator is bounded 
from below and dominates, in some sense, the dissipation operator. More precisely, we 
have 

Definition 2.2. A diagonalizable equation (12.31) is called hyperbolic on the time 
interval [0, T] if 

(1) there exist positive numbers C* , ci,c 2 such that {nt + O^k + C*, k > 1} is a 
positive, non-decreasing, and unbounded sequence for all 9 e 0i and 

foA\ ^ K k + er k + C* 

{2A) Cl - , k + 0'r k + C* * C2 

for all 6,6' e &n 

(2) there exist positive numbers C, J such that, for all k > J and all Q\ G 0i, 6 2 E 

e 2; 

(2.5) T(p k + 6 2 u k ) < \n( Kk + 9 X T k ) + C. 

Condition (12.51) means that there is no restriction on the strength of dissipation, but 
amplification must be weak. For example, let A be the Laplace operator in a smooth 
bounded domain G C M, d with zero boundary conditions, and H = L 2 (G). Then each 
of the following equations is diagonalizable and hyperbolic on [0,T] for all T > 0: 



^ ^ u tt = Au + u t + W, u tt = Au-Ut + W, 

u*t = A(« + u t ) + W, u tt = Au- A 2 u t + W, 

while equations 

u tt = A(u - u t ) + W, u tt = Au + A 2 u t + W 
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are diagonalizable but not hyperbolic on any [0, T]. To construct an example of an 
equation that is hyperbolic on every time interval [0,T] and has unbounded amplifi- 
cation, take Q\ = 9 2 = 1 and consider the operators with eigenvalues n k = p k = 0, 
Tk = e k , v k = Ink. 

The following result shows that, in a hyperbolic equation, the evolution operator is 
uniformly bounded from below. 

Proposition 2.3. If equation (12.31) is diagonalizable and hyperbolic, then 

(2.7) lim (n k + 9r k ) = +oo 

uniformly in 9 G ©i, and there exists an index J > 1 and a number Co such that, for 
all k > J and 9 G ©i ; 

(2.8) K k + 0T k >l, 

(2-9) < c . 

K k + 9r k 

Proof. To simplify the notations, define 

A*(0) = Kfc + #T fc . 

Since (Afe(^) + C*, k > 1} is a positive, non- decreasing, and unbounded sequence for 
all G 0i and (T23D holds, we have ([H]), and then follows. 

To prove (I2.9p . we argue by contradiction. Assume that the sequence {\r k \X k l {9),k > 
1} is not uniformly bounded. Then there is a sequence {\r kj \ \ k . (9j), j > 1} such that 

(2.10) lim - ^ = +oo. 

With no loss of generality, assume that r kj > 0, and, since ©i is compact, we also 
assume that lim^oc 9j = 9° G ©i (if not, extract a further sub-sequence). 
Then (12.101) implies 

(2.11) lim ^ = -9°. 

Note that lim^oo \r kj \ = +oo, because \\mj^ 00 {9°r kj + n kj ) = +oo. Consequently, 

j-voo \ k .(9°) + C* 9° + lim j ^ 00 {K kj /T kj ) 

As a result, if (TJU) fails, then so does (T22D for 9 ^ 9°, 9' = 9°. □ 

To state the result about existence and uniqueness of solution for (I2.3p . note that we 
do not have enough information about the operators Ai and £>j to define the traditional 
variational solution because we are not assuming that the operators act in a normal 
triple of Hilbert spaces — the usual setting to define a variational solution (see, for 
example, Chow [2j Section 6.8]). On the other hand, if the operators Ai,Bi were 
bounded and if the process W were i7-valued, then there would be a unique process 
v = v(t) with continuous trajectories in H such that u{t) = f Q v(s)ds and 

v(t)+ [ (A + 9 1 A 1 )u{s)ds = [ (B + 9 2 B 1 )v{s)ds + W{s); 
Jo Jo 
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see Chow |2] Theorem 6.8.2]. If, in addition, equation (12. 3p is diagonalizable, then u 
would have the following expansion in the basis {h k , k > 1}: 

(2.12) u(t) = J2Mt)h k , 

k>l 

(2.13) u k {t) - (p k + 2 Vk)u k (t) + (n k + 9iT k )u k (t) = w k (t), u k (0) = u k (0) = 0. 

The basis {h k , k > 1} thus becomes a natural collection of test functions. 

Since the operators Ai, Bi are in general not bounded on H and the process W is 
not if- valued, we use the auxiliary space X and establish the following result. 

Theorem 2.4. Assume that equation (12.31) is diagonalizable and hyperbolic. Then 
there is a unique adapted X -valued process u = u(t) with representation (12.121) . (12. 131) .- 
we call the process u a generalized solution of (12. 3p . If, in addition, there exists a 
real number Co such that Q<iv k + p k < Co for all k, then v(t) = u(t) is also an X -valued 
process. 

Let us make a few comments about the result. 



(1) By Lemma [2T3l we know that n k + 9ir k > 1 for all sufficiently large k. Condition 
(12. 5p means certain subordination of the dissipation operator Bo + Q%B\ to the 
evolution operator Ao + OiAi. In particular, any dissipation (negative p k = 
p k + #2^) is admissible, as well as certain unbounded amplification (positive 
and unbounded p: k ), as long as the sequence {p k , k > 1} does not grow too 
fast; the critical growth rate depends on the length of the time interval. This 
possibility to have an unbounded dissipation operator makes the result different 
from those considered in the literature, such as [21 Theorem 6.8.4]. 

(2) The resulting generalized solution is weak in the PDE sense, but is strong in 
the probabilistic sense, being constructed on a given stochastic basis; 

(3) The solution is defined by its Fourier coefficients and therefore does not depend 
on the choice of the space X. The role of X is to ensure that the equation is 
well-posed in the sense that the output process (the solution u) takes values in 
the same space as the "input" process W . Given the special form of W, we are 
not discussing any continuous dependence of u on W . 



Proof of Theorem \2.4\ To simplify the presentation, introduce the notations 

(2.14) A fe = K fc + 6>ir fc , p k = p k + 9 2 v k . 

For a fixed k > 1, let us consider the process u k defined by (12.131) . Equation (12.131) 
has a unique solution, and direct computations show that 

(2.15) u k (t) = [ f k {t-s)dw k {s), 

Jo 

where the fundamental solution satisfies 

(2.16) f k {t) - fM h \ h (t) + A fe f fe (t) = 0, f A (0) = 0, f fc (0) = 1; 

see Appendix for details. Thus, ^u k (t) = and, since the processes u k are independent 
for different k, the series (12.121) defines an X-valued process if 

(2.17) sup sup Elii^i)! 2 < oo. 

fc>i te[o,T] 
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By direct computation using (12.151) and the ltd isometry, 

(2.18) E\u k (t)\ 2 = [ f k (t-s)ds= [ f k (s)ds. 

Jo Jo 

The proof of the theorem is thus reduced to the study of the fundamental solution f k 
for sufficiently large k. More precisely, we will show that 

(2.19) sup supffe(t) < oo, 

te[0,T] k 

which, by (12381) . implies (1217ft . 

The solution of equation (12.161) is determined by the roots r± of the characteristic 
equation 

M nn\ 2 , \ n ^ k ^ ~ 4 ^ 

(2.20) r - /i fc r + X k = : r± = ^ • 

By Lemma [2.31 lim^ooAfc = +oo, and, in particular, X k > for all sufficiently large 
k. Also, condition (12.51) means that if \i k > 0, then \i k < (ln\ k + C)/T, and therefore 
fit < 2\f\ k for all sufficiently large k. Accordingly, we assume that > and consider 
two cases: \^\ < 2\/Afc and fi k < 

If \nk\ < 2y/\k, then equation (12.201) has complex conjugate roots, and, with £ k = 

- (rim, 

(2.21) fM=( V-(^) 2 . 

If // fc < 0, then f k < T 2 for all t G [0,T] and (12191) follows. If \i h > 0, then, for 
sufficiently large k, condition (12. 5p ensures that e^* < X k e c and A fc /^ < 2. Then 
f k < 2T 2 e c and (I2l9|) follows. 

If £*fc < — then f!2.20|) has real roots (a double root if = — 2V%r), and, using 

the notations i k = \J H 2 k — 4A&, a = [i k + £ k , 

(2.22) |»(t) = tV* J ; 

the case of the double root corresponds to the limit £fc — > 0. By assumption, a < 0, so 
that f|(t) < T 2 and (12191) follows. 

Similarly, v(t) = Y, k v kif)h k , v k {t) = f ) k {t - s)dw k (s), and Ev k (t) = J ' \\ k (s)\ 2 ds. 
By direct computation, if /i fe < C , then sup tg [ T ] sup fc |ffc(t)| 2 < oo, and therefore 
v(L) e X. 

This completes the proof of Theorem 12.41 □ 

3. Estimation of Parameters 

Assume that the solution of equation (12. 3p is observed so that the measurements of 
u k {t) and v k {t) = u k are available for all t G [0, T] and k — 1, . . . , N. The objective is 
to estimate the parameters 61,62- We keep notations (11.41) . and also define 



(3.1) 



A fc (0) = n k + 6r k , n k {6) = p k + 6u k . 
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Since 

(3.2) dv k {t) = ( - \ k {0i)u k + pk{9 2 )v k )dt + dw k {t) 

(see (12.131) ). and u k {t) = J^Vk(s)ds, the vector process v = (vi, . . . ,v^) is a diffusion- 
type process in the sense of Liptser and Shiryaev; see [U Definition 4.2.7]. Therefore, 
by Theorem 7.6 in [8] (see also Section 7.2.7 of the same reference), the measure P v 
generated by the process v in the space of M^-valued continuous functions on [0, T] 
is absolutely continuous with respect to the measure P w , generated in the same space 
by the iV-dimensional standard Brownian motion w = (w\, . . . ,wn)- Moreover, the 
density Z = dP v /dP w has a representation 

N 



Z(v) = exp ( V ( / ( - A fc (0i)u fc (*) + I2 k (6 2 )v k (t))dv k (t) 
\k=i 7o 

( - \ k (6i)u k (t) + jj k (6 2 )v k (t)) 2 dt 



1 ' T 



Define 

3 = lnZ(v). 

Note that 3 is a function of 9i,9 2 , and the maximum likelihood estimator of the pa- 
rameters 6*i , 9 2 is computed by solving the system of equations 

with unknowns 9\,9 2 . This system can be written as 

Fi : n + Li iN + K ltN 9i + K 12 ^ N 9 2 = A 1<N 
F 2 ,n + L 2N + Ki 2)N 9i + K 2}N 9 2 = A 2)N) 



(3.4) 



where 
(3.5) 



u k v k (t)dv k (t), 



Ai, N = - V] / r k u k (t)dv k (t), A 2tN = V} / 
k=i Jo k=i Jo 

N T N 
Fl,N = - ^2 / K kTkU 2 k (t)dt, F 2:N = ^ / 

k=l J ° k=l J ° 



p k VkV k (t)dt, 



N „t N r T N r T 

k i.n = ^2 / r^u 2 k {t)dt, K 2tN = ^ / "IvKtjdt, K i2,N = - ^ / v k rkUk{t)v k {t)dt, 
k=i Jo k=i Jo k=i Jo 

N T N T 

Li,n = ~ ^ / p k T k u k (i)v k (t)dt, L 2 , N = ~ ^ / KkVkUk{t)v k {t)dt. 
k=i Jo k=i Jo 



All the numbers A, F, L and F are computable from the observations of «&(£) and 

u fc (t), fc = i,...,iv, te [0,T]. 



10 W. LIU AND S. V. LOTOTSKY 

Note that 

1 N 1 N 1 - 

K 12 ,n = -- 22T k u k u 2 k (T), L hN = --22p k T k u 2 k (T), L 2jN = --22K k u k u 2 k (T), 

k=l k=l k=\ 

because, by assumption, u k (0) = and thus 

f T 1 

u k v k (t)dt = J u k (t)du k {t) = -u 2 k (T). 

By the Cauchy-Schwartz inequality, Ki^K 2 ,n — Kf 2 N > with probability one, 
because the process u k is not a scalar multiple of v k . Therefore (13. 4p has a unique 
solution 

£ K 2) n(^1,N — Fl,N — L\ : n) — Ki 2N [A 2jN — L 2 .n — F 2; n) 
Ul ' N ~ t? t? rFi ' 

(3.6) 

= 1? 1? 172 ■ 

With notations (13.51) in mind, formulas (13.61) provide explicit expressions for the 
maximum likelihood estimators of 9\ and 9 2 . To study asymptotic properties of these 
estimators, we need expressions for 9 it N — @i, i = 1, 2: 

V\,n — Vi 



/g y\ 1 ~~ -^Jv V^i.JV K 1)N K 2>N 

V2,N — V2 



1 - -Dat V.-^2,Af K 1>N K 2 



N 



where 
(3.8) 

N r T N r T J^2 



i<i,n = - ^ / T k u k (t)dw k (t), i 2jN = / u k v k (t)dw k (t), D N 

k=l J ° k=l J ° 



12,N 



K ltN K 2t 



N 



It follows that, as iV — » oo, asymptotic behavior of the estimators is determined by 
Li t N/Ki,N> i — 1) 2, and K\2,n/ {K\,nK2,n)- Note that each of t^jy, i^jv, K\2,n is a sum 
of independent random variables. Moreover, 

(3.9) Eijjy = E^ iiV , i = 1, 2. 
If ffc is the function satisfying 

(3.10) f fe (t) - n h (8 2 )U(t) + A fc (0i)f fc (*) = 0, f fc (0) = 0, f fc (0) = 1, 

then, by direct computation, Wfc(t) = J * ffc(i— s)dw k (s) (see Appendix for more details), 
so that 

E«fc(*)= f\h(s)\ 2 ds, Ev 2 k (t)= flU^ds, 
Jo Jo 
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and 



* 1>N := EK liN = Vr t 2 f / \f k (s)\ 2 dsdt, 

fc =i Jo Jo 

(3.11) V 2>n :='EK2,n = J24 / \h(s)\ 2 dsdt, 

k=i Jo Jo 

1 - f T 

y 12>N :=EK 12tN = --^r fe z/ fc / |f fc (s) | 2 rfs. 

k=i ^° 

The following is a necessary conditions for the consistency of the estimators. 

Proposition 3.1. J/linijv-^oo Qi,n — ®% i n probability, then liniAr^oo ^i t N = +oo. Sim- 
ilarly, i/linijv-^oo @2,N = Q% in probability, then liniTv-^oo ^2,n = +oo. 

Proof. Each of the sequences {^jv, N > 1} is monotonically increasing and thus has 
a limit, finite or infinite. If limjv^oo >A r < oo, then liniTv^oo k,N I K i)N exists with 
probability one and is a non-degenerate random variable. Equalities (13 .7p then implies 
that di^N cannot converge to Q{. □ 

Under the assumptions of Theorem 12. 4[ we derived a bound |ffc(t)| 2 < const. ■ T 2 , 
which was enough to establish existence and uniqueness of solution of (12. To study 
estimators O^n, and, in particular, convergence/divergece of the sequences {^at, -W > 
1}, we need more delicate bounds on both |ffc(i)| 2 and |ffc(t)| 2 - The computations, 
while relatively straightforward, are rather long and lead to the following relations (see 
f ll.lOP for the definition of ~): 

(3.12) Eu 2 k (T) ~ -1— — — — , Var M 2 (T)~3 / 



2 / i k (e 2 )x k (e 1 y feV ' V 2 ^(^)A fe (^ 



/■ T 9/s T 2 M(Tu k (6 2 )) f T „ /s T 4 WTu fc (# 2 )) 

(3.13) e/ r^rr^' Var / 

(3.14) e/ v 2 k (t)dt~T 2 M(Tfi k (9 2 )), Var/ v 2 k {t)dt ^ T A V (T ^ k {6 2 )) , 

Jo Jo 



where 

(3.15) M(x) 



eZ - x ~ 1 if x o 
i 2x 2 ' 1IX ^ U ' 

-, if x = 0; 

e 2x + 4e x ' — 4xe :E — 2x — 5 



if ac ^ 0, 
if ac = 0. 



(3.16) V{x) = \ l 4x 4 

24' 

Note that the functions M and V are continuous and positive on K, and 

,o in u , ,., J (2|^|) _1 , x-*-oo, J4(2|x|)- 3 , x-^-oo, 

(3 - 17) M(XH < 2(2*)- e», x-+oc; ^ ~ 4(2*)- e 2 *, * - +oo. 
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The computations leading to (I3.12I) - (I3.14I) rely on the fact that u k and v k are Gauss- 
ian processes, so that, for example, 

Var^ u 2 k {t)dt = Aj {^(u{t)u{s)fj dsdt. 

It follows from (13. 131) and ( 13 . 141) that if liniTv^oo ^i,N = +oo, then 

(3.18) *i*~^it ^ M j; T ( gf 2)) > ^, N -T^lM(T^(e 2 )). 

k=i k ^ l > k=i 

Relations (13. 18j) show that conditions for consistency and asymptotic normality of 
the estimators require additional assumptions on the asymptotical behavior of the 
eigenvalues of the operators Ai, Bi. 

The asymptotic behavior of the eigenvalues of an operator is well-known when the 
operator is elliptic and self-adjoint. For example, let D be an operator defined on 
smooth functions by 

i,j=l 1 v ■> / 

in a smooth bounded domain G C Mr, with zero Dirichlet boundary conditions. Assume 
that the functions Qj{j £1X6 all infinitely differentiable in G and are bounded with all 
the derivatives, and the matrix (aij(x), i,j = l,...,d) is symmetric and uniformly 
positive-definite for all x £ G. Then the eigenvalues dk of T> can be enumerated so that 

(3.19) d k x k 2 ' d 

in the sense of notation (11.101) . More generally, for a positive-definite elliptic self- 
adjoint differential or pseudo-differential operator D of order m on a smooth bounded 
domain in M, d with suitable boundary conditions or on a smooth compact (^-dimensional 
manifold, the asymptotic of the eigenvalues d k , k > 1, is 

(3.20) d k x k m/d - 

note that m can be an arbitrary positive number. This result is well-known; see, for 
example, Safarov and Vassiliev [TlT Section 1.2]. An example of T> is (1 — A) m / 2 , m > 0, 
where A is the Laplace operator; note also that, for this operator, relation (13.201) holds 
even when m < 0. 

In our setting, when the operators are definedbj their eigenvalues and eigenfunctions, 
more exotic eigenvalues are possible, for example, r k = e k or v k = (—l) k /k. On the 
other hand, it is clear that the analysis of the estimators should be easier when all the 
eigenvalues in the equation are of the type (I3.20p . Accordingly, we make the following 

Definition 3.2. Equation (12.31) is called algebraically hyperbolic if it is diago- 
nalizable, hyperbolic, and the eigenvalues \ k (0) = n k + 9r k , n k {6) = p k + 9u k have the 
following properties: 

(1) There exist real numbers a, ct\ such that, for all 9 6 1; 

(3.21) \ k {6)~k a , |r fc |xfc Ql ; 
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(2) Either \p, k (9)\ < C for all G ©2 or there exist numbers (3 > 0, Pi 6 R suc/i 
t/iat, /or a// G 9 2 , 

(3.22) -M^^> hkl-A;* 

To emphasize the importance of the numbers a and /3, we will sometimes say that 
the equation is (a, /^-algebraically hyperbolic; /3 = includes the case of uniformly 
bounded 

The reader can easily verify that 

• under hyperbolicity assumption, a > and no unbounded amplification is 
possible; 

• each of the equations in (12.61) is algebraically hyperbolic. 

4. Analysis of Estimators: Algebraic Case 

Theorem 4.1. Assume that equation (12.31) is (a, (3) -algebraically hyperbolic in the 
sense of Definition ^. 21 

(1) V 

(A-\\ a + P-1 
I 4 - 1 ) «i > g ' 

then the estimator is strongly consistent and asymptotically normal with 
rate a $ N — > oo: 

(4.2) lim = 9\ with probability one; 

N—>oo 

(4.3) lim v/^ijv( 0i n — 0i ) = £i in distribution, 

where £i zs a standard Gaussian random variable. 

(2) // 

(4-4) A > 

i/ien t/je estimator 02,at is strongly consistent and asymptotically normal with 
rate a/^vv as iV — > oo: 

(4.5) lim 2 .jv = 02 with probability one; 

(4.6) lim v/^2Jv(02Ar — 02 ) = £2 in distribution, 

where £ 2 is a standard Gaussian random variable. 

(3) If both (14.11) and (14. 4p no/d, £nen £ne random variables £1,^2 are independent. 

Remark 4.2. (oj In terms of the orders of the operators (see (I3.20p ) . condition (14.11) 
becomes 

(4.7) order(A) > order (A) + 0i^i) + order(ff + gggQ - rf ^ 
and condition (14. 4D becomes 

(4.8) order(^) > °^er(go + W - d 
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(b ) The condition for consistency of §2,n does not depend on the evolution operator and 
is similar to the consistency condition in the parabolic case [SI Theorem 2.1]. 

The intuition behind conditions (14.71) and (14.81) is as follows. The information about 
the numbers 6i, 62 is carried by the terms A\U and Biu t , respectively, and these terms 
must be irregular enough to be distinguishable in the noise W during a finite obser- 
vation window [0,T]. The higher the orders of the operators, the more irregular the 
terms, the easier the estimation. 



Proof of Theorem J^.l, Note that if j3 > 0, then lim^oo = —00, and therefore, 

by earn, 

(4.9) M t (T, kW ) ~ * V t (TM<>)) ~ * *r*. 



Let 

71 = 2«i - a - /?, 72 = 2/?i - /?, 7 12 = «i - a + ft - ft 
We have (see (II .9p for the definition of ex) 

(4.10) r 2 E [ u 2 k (t)dt txi k^ 1 , r fc 4 Var / u\(t)dt ex k 271 "^, 

Jo Jo 

(4.11) i/|E /" v 2 k (t)dt txi k 72 , i/*Var / v 2 k (t)dt tx) k 2 ^? , 

Jo Jo 

(4.12) |^T fc | Eitj[(T) ex F 12 , v 2 k T%Varu 2 k (T) ex F 712 , 
and therefore 

const., if 71 < —1, I const., if 72 < — 1, 

(4.13) #i )iV cx ^ IniV, if 71 = -1, ^ 2 ,iv m < IniV, if 72 = -1, 

A™* 1 , if 7l > -1, I N^ +1 , if 72 > -1, 







const., 


if 712 < 


-1, 


(4.14) 


|*12,JV| 1X1 < 


IniV, 


if 712 = 


-1, 








if 712 > 


-1. 



Next, we show that condition (14. ip implies 

(4.15) lim 1,7V = 1 with probability one, 
condition (14. 4p implies 

(4.16) lim 2,JV = 1 with probability one, 

N^oo W2 at 

and either flU]) or (tOjl . 

(4.17) lim Dn = with probability one. 



Indeed, convergence (14. 15ft follows from ( I3.13P and ( 1A.10p . because (14.11) implies 
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Similarly, (I4.16P follows from (I3.14p and flA.lOp . because (14.41) implies 

'n,2 



2 < °°- 



For (I4.17p . we first observe that lmiTv-^oo -^12.^/^12,^ exists with probability one. If 
712 < — 1, the the limit is a P-a.s finite random variable. If 712 > — 1, the (I3.12p and 
(lA.lOp imply that limit is 1. Then direct analysis shows that 

lim = 

N-+oc Wi iA rW 2l V 

if at least one of ^i,n, ^2,n is unbounded. 
Next, we show that (14.11) implies 

(4.18) lim Ll ' N = with probability one, 
and 

(4.19) lim — 7^== — £1 in distribution, 
whereas (14.41) implies 

(4.20) lim L2 ' N = with probability one, 

iV— »oo W 2 ]\f 

and 

(4.21) lim — L<2,N = £ 2 i n distribution. 

N -*°° V^tv 

Indeed, (I4.18P follows from (13 . 1 3[) and flA.5p . because (14.11) implies that J2 k k 11 = +00. 
Similarly, (05]l follows from (ETT3|) and fOTol) . 

Both fT4TT9l) and fT4T2TD follow from Corollary \KM Together with (14371) . the same 
Corollary also implies independence of £1 and £ 2 if both (14.11) and (I4.4p hold. 

To complete the proof of the theorem it remains to show that 

(4.22) lim * 2,jV =0, i — 1,2, with probability one, 
and 

(4.23) hm — = 0, 1 = 1,2, m probability. 

N->oo Ki^ N K 2) N 

We leave to the interested reader to verify that (1A.5[) implies (14.221) , and (I4.17P , (I4.19P , 
d42T|) imply (T4T23D . 

This completes the proof of Theorem 14.11 □ 

Remark 4.3. From Proposition \3.1\ we see that condition (14.11) is both necessary 
and sufficient for consistency and asymptotic normality of estimator d\^. Similarly, 
condition (14. 4p is necessary and sufficient for consistency and asymptotic normality of 
estimator 62 n- 
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Since in the algebraic case the sum Ylk=i ^ 7 a PP ears frequently, we introduce a 
special notation to describe the asymptotic of this sum as N —>■ oo for 7 > — 1: 



(4.24) TCV( 7 ) 



N"> +1 , if 7 > -1, 
In N, if7 = -l. 



With this notation, ^2 k=l k 1 x Tjv( 7 ), 7 > — 1- 

Let us consider several examples, in which A is the Laplace operator in a smooth 
bounded domain G in R d with zero boundary conditions; H = L 2 {G). We start with 
these three equations: 

(4.25) ut t = B x Au + 6 2 u t + W, 6i> 0, 6 2 G R; 

(4.26) u tt = A(0 x u + 2 t*t) + W, 0! > 0, # 2 > 0; 

(4.27) utt = OiAu - 9 2 A 2 u t + W, 6 l > 0, 9 2 > 0. 

The following table summarizes the results: 



Asymptotic 


Eq. (I4.25P 


Eq. (I4.26P 


Eq. (14.271) 






A/ 


T N (-2/d), d>2 


*2,V 


N 


Ni +1 


iVl +1 



In equations fl4.25l) - fl4.27l) . and E\ are leading operators, that is, a — a,\ and 
P = (3\. This, in particular, ensures that the estimator # 2 ,iv is always consistent. 
Let us now consider examples when A\ and B\ are not the leading operators: 

(4.28) u tt = (Am + B x u) + (Au t + 2 u t ) + W, B x G R, # 2 G R; 

(4.29) ita + (A 2 u + Bxu) = (9 2 Au t - A 2 u t ) + W,9 1 e R, fl 2 G 

(4.30) utt + (A 2 u + 9 1 Au) = (6 2 u t - A 2 u t ) + W, 9\ G R, # 2 G R. 

The following table summarizes the results: 



Asymptotic 


Eq. (I4.28P 


Eq. (I4.29P 


Eq. (I4.30P 




T^-4/d), d>4 


Tjv(-8/d), d > 8 


T JV (-4/d), d > 4 


^2,7V 


T N (-2/d), d>2 


A7 


T w (-4/d), d > 4 



As was mentioned in the Introduction, an interested reader can investigate a four- 
parameter estimation problem, such as 

u tt + (#nA 2 M + e l2 Au) = (e 21 u t - e 22 A 2 u t ) + w. 
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5. Analysis of Estimators: General Case 



While the algebraic case, corresponding to elliptic partial differential operators, 
seems the most natural, we believe that a more general case, allowing eigenvalues 
such as Xk ~ e k or ~ In k, is also worth considering, not only as a mathematical cu- 
riosity, but also as an example of a model with observations coming from independent 
but not identical channels (see Korostelev and Yin [6]). 

As the proof of Theorem 14.11 shows, the key arguments involve a suitable law of 
large numbers. Verification of the corresponding conditions is straightforward in the 
algebraic case, but is impossible in the general case unless we make additional assump- 
tions about the eigenvalues of the operators. Indeed, as we work with weighted sums 
of independent random variables, we need some conditions on the weights for a law of 
large numbers to hold. In particular, the weights should not grow too fast: if £ fc , k > 1, 
are iid standard Gaussian random variables, then the sequence {n~ 2 Ylk=i n £L n >1} 
converges with probability one to 1/2, but {e~ n J2k=i ek £h n — 1} does n °t have a 
limit, even in probability. 

Theorem IA.2I in Appendix summarizes some of the laws of large numbers, and leads 
to the following 

Definition 5.1. The sequence {a n , n > 1} of positive numbers is called slowly 
increasing if 



The purpose of this definition is to simplify the statement of the main theorem 
(Theorem 15.21 below). It was not necessary in the algebraic case because the sequence 
{n 7 , n > 1} is slowly increasing if and only if 7 > —1. The reason for the terminology 
is that the sequence {e" r , n > 1} has property (15.1 ft if and only if r < 1. Further 
discussion of (15. ip . including the connections with the weak law of large numbers, is 
after the proof of Theorem IA.2I 

In general, we have to replace (14.11) with 

Condition 1. The sequence {r^M(T/i fc (# 2 ))/Afc(#i), k > 1} is slowly increasing, 
and (H3D, with 

Condition 2. The sequence {u 2 k M(Tfi k {9 2 )), k > 1} is slowly increasing. 

Theorem 5.2. Assume that equation (I2.3P is diagonalizable and hyperbolic. 
(1) If Condition 1 holds, then 



(5.1) 



lim 



V n a 2 



0. 




2 



(5.2) 



N— >oo 



lim 6 



l,N = 



61 in probability; 



(5.3) 




where £1 is a standard Gaussian random variable. 
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(2) // Condition 2 holds then 

(5.4) lim §2,n — @2 in probability; 

N—>oo ' 

(5.5) lim ^/^2,n ( 9 2 ,n — 021 = £2 m distribution, 

where £2 is a standard Gaussian random variable. 

(3) If both Conditions 1 and 2 hold, then the random variables ^1,^2 ore indepen- 
dent. 

Proof. The main steps are the same as in the algebraic case (Theorem 14. ip . In par- 
ticular, (I4.18P and (14.201) continue to hold as long as \&i,jv — > 00 and ^2,n — ► 00, 
respectively. The only difference is that Conditions 1 and 2 do not provide enough in- 
formation about the almost sure behavior of K^n/EK^n, and, in this general setting, 
there is no natural condition that would do that. As a result, in (14.171) . the convergence 
is in probability rather than with probability one, and then, in both (14.151) and (I4.16p . 
convergence in probability will suffice. Conditions 1 and 2 ensure (14.151) and (I4.16p . 
respectively, but with convergence in probability rather than almost sure. This is a 
direct consequence of the weak law of large numbers. 
In the case of (I4.17p . we have 

N 

®\K 12>N \ <^\T k v k \Eu 2 k (T) 

k=l 

and, for all sufficiently large k, 

AT / 
Eu 2 h {T) < ^—M(Tft k (d 2 ))(l + max (O,2>*(0 2 )) 

because xe x — x < A(e x — x — 1)(1 + max(0, x)) for all iGl Then 

(5.6) lim ElKl2 > Nl = 0. 

Indeed, under Condition 1, (I5.6P follows from 

(E|K 12 ,jv|J < 10 2^=1 A fc (ei) A h (fli) 



*1,JV*2,JV T 2 V JV r fc 2 M(?> fc (0 2 )) 

(Cauchy-Schwartz inequality) and 

(l + max(0,TM^))) 2 
(5.7) hm ^ — — = 

(hyperbolicity condition), while, under Condition 2, (15. 6p follows from 

^ lr , , N 2 2i\ / r(r r fa\\ ( 1+max (o,TM fc (6» 2 ))) 
(E\K l2iN \) < WEk=lH M { T t 1 k(02)) A ^ LL 



^1,N^2,N ~ T 2 £f =1 ^M(T/l fc (#2)) 

(Cauchy-Schwartz inequality with a different arrangement of terms) and (15.71) . 

The interested reader can fill in the details in the rest of the proof. □ 
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As an example, consider the operators with eigenvalues K k = e 2k , r k = e k , p k = 0, 
V). = lnln(/c + 3) and assume that 9\ > 0, 9 2 > 0. Then 

\ k = e 2k + 9 x e k , p k = 9 2 \n\n(k + 3), 

so that r|/Afe ~ 1. Next, for all sufficiently large k, 

( ln(fc + 3))™ 2/2 <M(Tp k ) < (ln(k + 3)) Td2 , 

and also v k M{Tp k ) x (ln(/c + 3)) Te2 . Using integral comparison, we conclude that, 
for all r > 0, 

JV 

^(lnA;) r ~ A^(lnA^) r . 

k=l 



Thus, both Condition 1 and Condition 2 hold. By Theorem I5.2[ both 9%^ and 9 2: n 
are consistent and asymptotically normal. An interested reader can verify that 

N(lnN) T62 . . Td2 

(lnlnAT) 
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Appendix 

First, let us recall some basic facts about second-order stochastic ordinary differential 
equations with constant coefficients. Consider the initial value problem 

(A.l) ij{t) - 2by(t) + a 2 y(t) = 0, y(0) = 0, y(0) = 1. 

With 2b = p k (9 2 ) and a 2 = X k (9i), we recover (12.161) ; recall that X k (9i) > for all 
sufficiently large k. If £ = ^/\b 2 — a 2 \, then 



(sm{£t) M 



(A.2) y(t) 



e b \ a 2 > b 2 - 



te b \ a 2 = b 2 - 
e , a 1 < b 2 - 



as usual, sinhx = (e x — e x )/2. Note that if b < and b 2 > a 2 , then b + £ < 0. The 
solution of the inhomogeneous equation 

x{t) - 2bx{t) + a 2 x{t) = f(t), x(0) = i(0) = 

is then x(t) = JjJ y(t — s)f(s)ds. 

Next, we formulate the laws of large numbers and the central limit theorem used in 
the proof of consistency and asymptotic normality of the estimators. 

To begin, let us recall Kolmogorov's strong law of large numbers. 
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Theorem A.l. Let > 1} be a sequence of independent random variables with 

E£ 2 < oo. If {b n > 1} is an unbounded increasing sequence of real numbers (b n /* +oo) 
and 

L>i 6 n 2 Var(£ n ) < oo, then 

n 

(A.3) lim b- 1 V7&-E&) =0 

n^oo ' ' 

k=l 

with probability one. 

Proof. See, for example, Shiryaev [12, Theorem IV.3.2]. □ 

The following laws of large numbers, both strong and weak, are often used in the 
current paper. 

Theorem A. 2 (Several Laws of Large Numbers). Let Xk, k > 1, be independent 
random variables, each with zero mean and positive finite variance. If 

(A.4) ]TEy] = +oo, 

fe>i 

then 

(A. 5) lim — £j=i = with probability one. 

Next, assume in addition that 

(A.6) E X i< Cl {Ext 
for all k > 1, with c\ > independent of k. Then 

(A. 7) lim 



implies 



V w v 2 

Z^fc=l Afc 



(A.8) lim Afc = 1 in probability 



and 



(A.9) 



2 

2 " 



< oo, 



implies 



Efe=i Xfc 



(A. 10) lim = 1 witn probability one. 
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Proof. To prove (IA.5I) . we take = Xn an d b n = ^fc =1 Ex| an d a PPly Theorem lA.lj 
note that convergence of ^2 n b~ 2 ^Xn follows from divergence of J2k>i^Xk : 

vM< WJ__ I 



To prove (1A.10[) . we take £ n = x\ an d b n = X^ =1 Ey|, an d a g a i n a Pply Theorem lA.lj 
this time, we have to assume convergence of the series ^ n Var£ n 6~ 2 . Finally, 0A.80 
follows from ( 1A.7I) and Chebyshev's inequality. □ 

In other words, normalizing a sum of zero-mean random variables by the total vari- 
ance will give in the limit zero with probability one as ling as the total variance is 
unbounded, while normalizing a sum of positive random variables by the total mean 
will give in the limit one only under some additional assumptions. Given a collection 
of iid standard normal random variables k > 1}, an interested reader can verify 
that the sequence ( Ylk=i ek £l) I ( Ylk=i ek ) does not converge in probability as n — > oo. 
To understand the meaning of conditions (1A.7j) and (IA.9I) . note that if k > 1 



are iid non-negative random variables with E£i = A > 0, then, taking in Theorem lA.il 
b n = X]fc=i ^Cfc = we recover the classical strong law of large numbers: 



1 " 

lim - V, ik = A 



fc=l 



with probability one. In the second part of Theorem IA.21 we want to establish a similar 
result when the random variables are positive and independent, but not identically 
distributed. Condition flA.6j) (which holds, for example, for Gaussian random variables) 
allows us to apply Theorem I A. II with b n = Ylk=i ^ a k := ^Cfe > fo r an then 
conditions (1A.6I) and (1A.9j) become, respectively, 

(A.ll) ^a n = +oo, 

n>l 

On the other hand, if 



(ELi a k) 



< OO. 



En 
k=l 



2 



(A.13) lim ^ k=1 \ = 0, 

— (ELi«*) a 

then Chebyshev's inequality leads to a weak law of large numbers. 

In general, OA. lip does not imply flA.12|> or flA.13|> (take a n = e n ), nor does (IA.12D 
imply (lA.lip (take a n = 1/n 2 ), but obviously flA. 131) implies (lA.lip . An interested 
reader can also verify that the sequence {e^, n > 1} satisfies flA~T3l but not (|A~T2|) . 



On the other hand, since we use (1A.11I) and (IA.12I) to prove a strong law of large 
numbers, and use (1A.13j) to prove a weak law of large numbers, it will be natural to ex- 



pect that conditions (lA.lip and (1A. 12|) together are stronger than flA. 13h . Kronecker's 
Lemma (see [121 Lemma IV.3.2] with b n = (Ylk=i a «) 2 > x n = a n/^n) shows that this is 
indeed the case: (lA~TT|) and (|AT2|) imply flA~T3l . 
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We say that a sequence of positive numbers {a n , n > 1} is slowly increasing 
if condition (IA.13I) holds. The notion of a slowly increasing sequence simplifies the 
conditions for consistency and asymptotic normality of the estimators in the general 
(non-algebraic) setting. Related conditions in the context of the law of large numbers 
can be found, for example, in the paper pQ. If a n = n 7 , 7 e R (algebraic case), then 
(IA. 1 If) (that is, 7 > —1) implies (1A.12|) . which is the reason for the strong consistency 
in Theorem 14.11 

The following theorem is used to prove asymptotic normality of the estimators. 

Theorem A. 3 (A Martingale Central Limit Theorem). Let M i>n = M i>n {t), t > 0, 
n > 1, i — 1,2, be two sequences of continuous square-integrable martingales. If, for 
some T > 0, 

hm — — ■ = 1, 1 — 1,2, m probability, 

E(M n )(T) 



n— »oc 



and 



Um - iB^m = o in probabllity , 



E(M 1;n )(T) E(M 2 , n )(T) 



then 



lim f ^.(^^(M^XTjr^ \ =V(0i/) in distributioni 



M 2 , n (T)(E(M 2in )(T)) 



where J\f(0, I) is a two-dimensional vector whose components are independent standard 
Gaussian random variables. 

Proof. If X n and X are continuous square-integrable martingales with values in M. d 
such that X is a Gaussian process and lim n ^ 00 (X n )(T) = (X)(T) in probability, then 
lim n ^ 00 X n (T) = X(T) in distribution; recall that, for a vector-valued martingale 
X = (XW, . . . ,1^), (X)(t) is the symmetric matrix with entries (X«,X^)(t). This 
is one of the central limit theorems for martingales; see, for example, Lipster and 
Shiryaev [7, Theorem 5.5.11]. The result now follows if we take 



where 

M in (t) 

yl t,n .1/9! 1 L i ^1 

(E(M lin ,)(T)) 1/2 

and wi,W2 are independent standard Brownian motions. □ 

Corollary A. 4. Let = fi y k{t), t > 0, i = 1, 2, k > 1 be continuous, square- 
integrable processes and Wk = Wk(t) be independent standard Brownian motions. Define 



Ef=i Jo fi,k(t)dw k {t) 
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V 



N— »oo 



(A. 14) lim — - Tjr- 1 = 1 in probability, and 

Ef=i E Jo h,dt)f2,k(t)dt 



then 



lim „ „ 



lim f ^ ) = MO, 7) in distribution, 



where J\f(0, 1) is a two-dimensional vector whose components are independent standard 
Gaussian random variables. 

Proof. This follows from Theorem IA.3I by taking 

Efc=i/o/i,fc(s)dwfc(s) 



M,n(t) 



because K(M iin )(T) = 1 and 
(M ljn ,M 2 , n )(T) = 



Eti/c ; fi,k(t)hk(t)dt 
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